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In differential pulse code modulation (DPCM) systems, often referred 
to as predictive quantizing systems, the quantizing noise manifests itself 
in two forms, granular noise and slope overload noise. The study of overload 
noise in DPCM may be abstracted to the following stochastic processes 
problem. Let the input to the system be a Gaussian stochastic process 
[x(t)\ with a bandlimited (0, f ) spectrum F(f). Denote the output of the 
system by y(t). Most of the time y(t) is equal to x(t). During time intervals 
of this kind, the absolute value of the derivative x'(t) = dx(t)/dt is less 
than a given positive constant x' . (In a DPCM system, x' = kf, where 
k is the maximum level of the quantizer and /„ is the sampling frequency.) 
There are time intervals, /«(#" , /,'") (i = 0, ±1, ±2, • • •), for which 
y(t) t* x(t). These time intervals begin at time instants t^' such that 
| .t'CCO I increases through the value x' n . For t t I { , y(t) = a?((J°) + 
(t — t l o )x' . The interval ends at t[ {) , when x(t) and y(t) become equal 
again. The overload noise in the DPCM system is defined to be n(t) = 
x(t) — y(t). The problem is to study the random process \n(t)}. In the 
present paper, ice will give an upper bound to the average noise power 
{n 2 (t)) a , which at the same time is a very good approximation to the noise 
power itself. 

Two previous attempts have been made to find (n 2 (t)) av . One, due to Rice 
and O'Neal, involves an approximation valid only for very large x' . 
Another approach to the problem, due to Zetterberg, includes an ingenious 
way of avoiding the determination of t[ i] . A new approach is given here 
that combines the best features of the two methods. The present result is a 
better approximation for slope overload noise than has been previously 
obtained. The result differs from previous results but is asymptotically 
equal to that given by Rice and O'Neal for x' — » oo . In the region where 
overload noise is important, the present result is in very good agreement 
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with computer simulation and experiment. The technique used could be 
applied for the determination of other statistical characteristics of the 
error random process. 

I. INTRODUCTION 

This paper is concerned with the slope overload noise in Differential 
Pulse Code Modulation (DPCM) systems, often referred to as predictive 
quantizing systems. Delta Modulation (AM), the simplest member 
of the DPCM family, is a European invention of the mid-forties. 1 
DPCM was first revealed in a Phillips Company patent 2 in 1951 and 
as a predictive quantizing system in a patent by C. C. Cutler of the 
Bell Telephone Laboratories in 1952. AM and DPCM are receiving 
renewed attention due to the present trend toward digital communica- 
tions and general efforts aimed at redundancy reduction 4 in picture 
transmission. The present work was motivated, to a large extent, by 
the application of DPCM to Picturephone® signal transmission. 

Work on AM and DPCM was reported in the early and mid-fifties. 
Most representative are the papers by (i) DeJager 5 on AM, mainly 
of introductory and descriptive nature, (it) Van de Weg 6 on uniform 
DPCM— we will refer to it in the sequel, and (Hi) Zetterberg 7 whose 
long paper on AM is the most detailed study of the subject to date. 
Recent publications note the beginning of a "renaissance" period for 
AM and DPCM. 8 ' 910 " 4 

In DPCM systems the quantization noise manifests itself in two 
forms, the granular noise and the slope overload noise. The granular 
noise is essentially uncorrected with the input signal and has a more 
or less flat power spectrum and an approximately uniform amplitude 
probability distribution, resembling the granular noise in standard 
PCM. The granular noise for single integration DPCM systems with 
a uniform quantizer has been studied by Van de Weg. 6 

In contrast with a straight PCM system, which overloads in ampli- 
tude, a differential PCM system overloads in slope. Consider a DPCM 
system (Fig. 1) with a single integrator in the feedback path and a 
symmetric quantizer which is not necessarily uniform. Practical DPCM 
systems have leaky integrators. For simplicity, we are considering only 
perfect integrators here. Let k be the maximum level of the quantizer 
and /. the sampling frequency. Then the maximum slope that the system 
can follow is x' = kf, , corresponding to the emission of a string of 
impulses of strength k by the quantizer of Fig. 1. For a fixed value of 
x' = kf, and for k — > the granular noise tends to zero, and the total 
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Fig. 1 — Single integration DPCM with a symmetric quantizer. 

noise is due to slope overload alone. In this paper, we concentrate on 
certain statistics of the overload noise defined precisely in Section III. 

II. SUMMARY OF RESULTS AND COMPARISON WITH PREVIOUS WORE! 

There exist two previous papers concerning overload noise in DPCM 
systems. Approximate results are given for the slope overload noise 
N in terms of the slope capability x' of the DPCM system and the 
power spectrum of the input signal, assumed to be Gaussian. The 
result due to Zetterbcrg 7 (with some corrections) is as follows 



N n . z = 



4V2/W3&!Y 



35x 3 \bo 



? ^U<X) exp -£■ 



26, 



where 6, and b 2 are the variances of the first and second derivatives 
of the input signal, respectively, and they are given in terms of the 
spectrum in (1) of the following section. The quantity X and the func- 
tion A(\) are defined in (31) and (32), respectively. The second result 
is due to Rice and O'Neal. 8 Their basic approximations are: (i) a trunca- 
tion of the Taylor series for x(t), around a transition point, including 
terms through the third derivative; and (ii) the assumption that the 
third derivative of x(t) at the transition points has, as a random variable, 
a very small variance compared to its mean value. Therefore, the third 
derivative is taken to be a deterministic constant with value equal to 
its mean. With these assumptions, (22) of Ref. 8 results in 



AV« = 



3&tY 



exp - 



4V27T \bJW / ""* V 2&j 

There are two points that we want to make here: 

(i) When the formula above together with an expression for the 
granular noise given in Ref. 8 are used to compute S/N we see that the 
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agreement with computer simulation is not very satisfactory in the 
region of severe slope overload. This formula does, however, identify 
the peak of the S/N ratio quite successfully (see Fig. 11). 

(ii) When we compare Zetterberg's and Rice's results by considering 
the ratio N .z/N , R we get 

10 log 10 ^r 1 = -5.36 + 10 log 10 A(X) dB. 

Thus, we see that the two results differ substantially. 

Hence, the question of the average slope overload noise power camiot 
be considered settled since the two results above are different and they 
both differ from computer simulation and experiment. The present 
paper sheds further light on the question of the slope overload noise. Our 
principle result is the approximation 

where the quantity x and the function A(x) are denned in (64) and 
(66), respectively. This expression, like the previous ones, is a function 
of only two things — the maximum slope capability x' of the DPCM 
system and the power spectrum of the input signal. Indeed all the varia- 
bles appearing in this formula are calculated directly from these two 
quantities only [see (1) and (64)]. The present formula gives better 
agreement with computer simulation than the one by Rice and O'Neal, 
when used to compute S/N (see Fig. 11). 

We might also point out here that the present work applies to any 
system which is slope limited, not just to DPCM or digital encoding 
systems. 

III. PROBLEM DEFINITION 

With reference to Fig. 1 let the input {x(t)\ be a stationary band- 
limited Gaussian random process. Let ^(t) be the autocorrelation func- 
tion of x(t) and F(f) the one-sided power spectrum. Let f be the band- 
width of x(t) and F, = /,// the normalized sampling frequency. The 
random process {x(t)\ is assumed to be zero mean. Let b„ be the variance 
of the nth derivative of x(t) (n = 1, 2, • • ■)• These numbers (&„) will be 
extensively used in the sequel. They are given by the relation 
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The output signal y(t) follows the input signal x(t) during certain time 
intervals. Within these time intervals 



dx(i) 
dt 



<x' 



The rest of the time y(t) follows segments of straight lines having slope 
Xq or — x' . If t is a time instant at which a transition from the input 
signal to the straight line segment takes place, we have 

..•'(/„) = c] ^r = * . «"(« > o 



or 



For 



x'(h) = -x' , x"(Q < 0. (2) 

(3) 



X'(t ) = X' 

?/(/) = .X-(/ ) + (/ - t Q )x t t (/o , /,) 

and for x'(to) = — x' Q 

v(0 = •<•(/") - (/- / )4 it (t ,/,), (4) 

where U is the smallest time t t > t Q for which 

x(h) = 'Aid = x(t ) + (/i - A,).f'(/n). (5) 

Since the overload noise is defined to be 

n(t) = .v(t) - y(t), (6) 

the problem boils down to the study of the random process [n(t)\. 
We will concentrate on the derivation of an upper bound to the average 
noise power (n 2 (t)) at which at the same time is a very good approxima- 
tion to the noise power itself. Other statistical properties of n(t) can 
be obtained, but we will only mention them at the conclusion of the 
paper. 

In contrast with straight PCM the evaluation of the overload noise 
in DPCM systems is not easy. The beginning of a slope overload burst 
can be defined statistically in a clear manner. Difficulties arise in 
defining a valid tractable procedure for determining the duration of 
the burst and its end point (£,). 
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As pointed out before two previous attempts have been made to 
find (n*(0>« - 7 ' 8 One, due to Rice and O'Neal, 8 involves a Taylor series 
approximation for determining the end point t x of the burst valid only 
for very large x' Q , i.e., in a region where slope overload noise is not 
dominant since it is over-shadowed by the granular part of the quantiza- 
tion error. Another approach to the problem is due to Zetterberg. 7 His 
approach includes an ingenious way of avoiding the determination of 
U . Unfortunately, his work contains a conceptual error in the averaging 
procedure. The error resides in his interpretation of continuous con- 
ditional probability density functions in the vertical window sense. 

A new approach is given here that combines the best features of the 
two methods. The result is asymptotically equal to that given by 
Rice and O'Neal for x' — > » . In the region where overload noise is 
important, the present result is in very good agreement with computer 
simulation and experiment. As noted above, the technique can also 
be applied to the determination of other statistical properties of the 
error random process. 

In Section IV, we give a critique of Zetterberg's work. It must be 
emphasized that Zetterberg's valuable work contains concepts and 
techniques on which our improved results are based. The wedding of 
the best in the methods of Rice and Zetterberg is accomplished in our 
Section V. Theoretical results are compared with computer simulation 
in Section VI and agreement is seen to be excellent.* Finally, in Section 
VII we indicate how other statistical properties of n{t) may be obtained 
by utilizing some of the approaches developed herein. 

IV. CRITIQUE OF ZETTERBERG'S APPROACH 

Using an argument based on the ergodicity of the random process 
[x(t)\ Zetterberg 7 states that 

(n 2 (/)> = (n\t))„ = &.'(/" n\k + s) dsy, (7) 

where 

s = t - t (g) 

Si = ti — to 

and S x -„ is the average number of points of transition per second. In 
what follows, we summarize his procedure deviating slightly from his 
notation and arguments to clarify a few points. Consider the ensemble 

* Comparison with experiments will be given in another paper. 11 
t ( ) denotes ensemble average and ( ) av time average. 
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of the sequences [/,(f))»t« = 0, ±1, ±2, ••• , of time instants such 
that x'ititf), f) = x' Q and s"(J,(f), f) > or x'foCf), f) = -x' and 
*"(**(f)i f ) ± for i = 0, ±1, ±2, • • • . Zetterberg avoids the definition 
of the end point of the burst by defining a sequence of random processes 
{mi(s, f)} (see Fig. 2), with index corresponding to the above time 
instants, in the following way: 

m,(s, f) = [.r(/.(r) + s, f) - .r(/,(f), r) - Zo'sMs) 

• M (.r(/,(f) + S, f) - .r(/,(f), f) - x(,s) (9) 



m L (s) 




m L (s) 



Fig. 2 — An overload noise "burst" m(s) and the approximating function mi(s). 

for 

sWD.fl = x'o and .T"(/,(r),f) > o, 
and 

m,(s, r) - [•'•(/. + s, f) - •'•(/. , f) + -i-os]m(s) 

• m (-.c(/. + s, r) + .!■(/, , r) - a-os) (io) 

for 

•r'(/. , r) = -4 . •<•"(/. - r) < o. 

(n(s) is the unit step.) 

t For clarity we show in this paragraph the input random process as generated 
by an experiment with outcome f . 
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For brevity, we drop the index i and the argument f . We denote, as 
before, the beginning of a burst by t , the end by t Y and by Si its duration, 
such that for a "positive burst," i.e., x'(t Q ) > we have 

m(s) = [x(t + s) - x(t ) - Xos]n(s)fi[x(t + s) — x(t ) - x' s]. (11) 

In general, as shown in Fig. 2, 7ti(s) contains not only noise burst cor- 
responding to the transition point t but also some additional "bursts" 
cut from the function x(t) by the straight line starting at the point 
(t Q , x(t )) and having slope x' . This makes 



[ m 2 (s) ds^ f n 2 (t + s) ds 

Jo "0 



and 



m'(s) ds) ^ 



n 2 (l + s) ds 



(12) 



(13) 



For sufficiently large values of x'Js/h x , (&i is the variance of x'(t)), 
however, the probability is small that the situation depicted in Fig. 2 
will occur. Also, generally the additional sections in ra(s) occur in 
reduced amplitude and the squaring reduces the introduced error still 
further. Denote by R x >. the average number of points for which 

x'(t<) = *o , x"(td > 



or 



x'fa) = -x' , X"{ti) < 0. 



It is seen from Fig. 3 that R Xo ^ 8 X >, , since a burst cannot start when 
another is taking place even if the conditions on the first and second 
derivative are satisfied. But again, for sufficiently large x' / s/bl , R x - Q 
is a good estimate of S x - . It follows from the discussion above that 
the quantity 



x(tK 
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Fig. 3 — K u A' 2 C Rx\ whereas K t C S x \ but K 2 <£ S x 
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R X .U m 2 (s)ds} (14) 

is an upper bound and actually under certain conditions a good estimate 
of<n a <fl>... 

When one defines 

<?,.„ = U" nr(s) da) = f* (nr(s)) ds, (15) 

where the equality above holds provided that the integrals exist, then 

No - R X ;Q X ; (16) 

is Zetterberg's upper bound to the overload noise. 

At this point Zetterberg takes the ensemble average (m (s)) in the 
following way: 

(m 2 (s)) = / / (x 2 - x, — Xos) 2 p(x, , x 2 | .i-, = x' ; s) dx 2 r/.r, 

•'-00 •'j, +x'„.< 

(•00 1»I|- x'oB 

+ / / (x 3 - Xi + xfcfyfa , x a I .i-i = -x'o ; s) dx 2 dx, , (17) 

•'-00 J— 00 

where p(a;, , x 2 1 a;, ; s) is the conditional joint probability density 
function of the random variables X x = x(t )X 2 = x(t + s) given the 
value of the random variable X t = dx(t )/dt, understood in the vectical 
window sense. It turns out that the averaging procedureasdescribed 
by (17) is wrong for two reasons: 

(l) The joint probability density of X, and X 2 should be subject 
not only to the condition X, = dx(t )/dt = dc x' , but also to the 
condition X x = d 2 x(t )/dt 2 ^ 0. If we do not impose the above con- 
dition on the second derivative at the beginning of the burst, then an 
m(s) of the form depicted in Fig. 4 would erroneously add to the ap- 
proximation of the average slope overload noise power per burst. 

(n) It is known 12 that conditional probability densities must be 
treated with great caution. M. Kac and D. Slepian in Ref. 12 have il- 
lustrated with examples how different the expression for conditional 
probability densities might be, depending on the way we understand 
them. From the ensemble viewpoint quantities like the conditional 
joint probability density for the rv X x = x(t ) and X 2 = x(t + s) given 
that X x = dx(t )/dt = x' n are not clearly defined since the set of sample 
functions with dx(t )/dt = x' has probability zero. We can of course 
give meaning to the conditional densities by means of limiting proce- 
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x'Uo)=xb X"(t )<0 

Fig. 4 — Consequences of not requiring x"(t ) to be positive. 

dures. As Kac and Slepian point out, a condition like dx(t )/dt = x& 
would be replaced by a condition, A, with nonzero probability, depend- 
ing on parameters, such that when these parameters tend to limiting 
values A becomes the condition dx(t )/dt = x' . It turns out that, in 
general, the resulting conditional probability density function depends 
on the manner in which A approaches the condition dx(t )/dt = x . 
Two window conditions are considered below. 

(i) A vertical window condition is a condition of the form 

z' < ^ < z£ + 5. (18) 

dt 

Then, with reference to Fig. 5(a), 
p(xi , Xi | x(Q = x'o ; s) vw 

p(xi) dxj 



where p(x, , x 2 , x x ; s) is the joint probability density function of the 
random variables X x = x(t ) X 2 = x(t + s) and X x = dxM/dt and 
p(x,) is the probability density function of the derivative X x = dx(t )/dt. 
Note that the time argument of the density functions above are written 
taking into account the stationarity of the input process {x(t)}. 

(ii) A horizontal window condition is a condition of the form dx(t)/dt = 
x' u for some t such that 

t ^ I ^ t + 8. 
Then, 

p(x x , x 2 | x'(to) = x'o ; s) ha 
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+ 



limj / dx" I p(xi , x 2 , x[ , x[' ; s) dx\ 

6—0 Wo Jx'o-x"ti 

/0 /»x' o— x 1 ' « 5 

<fcf J p(.r, , .r 2 , x[ , x[' ; s) dx[ 

■IT dx',' f p(a:{ ,:rDf/.r( 

k«>0 •'x , -j" 1 5 

+ f dx[' f ' p(x[ , x[') dxl 

f I x[ § I p(x, , x 2 , x' , x[' ; s) dx{' 
P | *{' I p(4 , x[') dx'/ 

J — to 



(20) 
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Fig. 5 — (a) A "vertical window'' condition, (b) A "horizontal window' 
condition. 
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where p{x 1 , x a , x[ , x[' ; s) is the joint probability density function 
of the random variables X, = x(t ), X 2 = x(t + s) , X[ = dx(t )/dt and 
X{' = d 2 x(t )/dt 2 and p(x[ , x[') the joint probability density of the 
random variables X[ and X[' . Equation (20) follows from the fact 
that the "horizontal window" condition is equivalent (within first 
order in small quantities and for a given second derivative, say x[' > 0) 
to x' - x[' 8 ^ dx(t )/dt ^ x' . For x[' < condition A is satisfied 
only if x' g dx(t )/dt ^ x' - x[' 8 [see Fig. 5(b)]. 

Consider now according to Kac and Slepian an "empirical or time 
derived joint probability density for x x and x 3 given that x'(t ) = x' " 
resulting from taking one sample function of the process and observing 
the values of x{t) and x(t + s) at each value of t for which dx(t)/dt = x' 
(s is of course a given number) . It turns out that the empirical or time 
derived density thus obtained is equal to the conditional density defined 
in the horizontal window sense. 

Note that if we impose the additional condition x"(t n ) > we have 

p(x, , x 2 | x'(to) = x' n , x"(t a ) > 0; s) hw 

x['p(xi , x 2 , x'o , x'x' ; s) dx[' 



f 



f° x'Mx' , x[') dx[' 



(20a) 



It will become clearer in a later section where the averaging is done 
carefully that one should interpret the conditional probability densities 
in the horizontal window sense. 

Zetterberg defines the conditional densities in the integrals of (17) 
in the vertical window sense; this follows from the way that he computes 
them. 

But let us overlook for a moment these shortcomings of Ref. 7 and 
continue with the approach presented there. For a Gaussian input 
process \x(t)} Zetterberg derives the following expression for Q x \ . 

Qx, ° = Vt r r k(s)u2 exp { ~* (m + 9( - s))2 ^ du ds> (2i) 



where 



k(s) = 2(+ - m ~ l{^} 2 (22) 

•»-A{ 1+ 4^}- (23) 
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b n (n = 1,2, • • •) is defined in (1) and 

*o = *(0). 

The following asymptotic expressions are valid (noted in Ref. 7). 
For 

s-+0 



9(s) 



„ . bos' 
~ 4 

36, 



(24) 
(25) 



For 



k(s) 

9(s) 



2^o 



.!■,& 



V2iAo 



(26) 
(27) 



(Note the meaning of the symbol « as used here: 

a:(s) ^ y(s) for s — > s 
if 

lim^=l.) 

An approximate calculation of the integral for Q x >, as given by (21) 
is based by Zetterberg on the following simplifications. He uses the 
asymptotic formula for g(s) for small s. This is a justifiable approxima- 
tion since the smaller values of g(s) are more important in the evaluation 
of the integral (21) and in any case the slopes of g(s) for s — * and s — > oo 
do not differ drastically. 



For Jc(s) he sets 



m = i 



6 2 s 4 
4 

[2^o 



where s l is determined such that 

4 



for s < .s'i 
, for s > s, , 

= 2^ n , 



(28) 



2132 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 10G7 



i.e., 

4 



Sl = J™. (29) 

\ bo 

The evaluation of the integrals (21) for Q,. are not correct as reported 
in Ref. 7.* In Appendix A the evaluation of the integral is made and 
the result is [see (90)] 

q., = MS(T) Sa <»' (30) 

\r 3l) 6/ \ x I 
where 



and 



with 



^VtM ^ 



A(X) = 1 + P(A)«T wa - Q(X)*(X) (32) 



P(X) = H X° + | X 4 - f - 1 (33) 

Q(X)=||x 7 + |x 5 (34) 

$(X) = f e -° V2 rfw. (3.5) 

For the number R x - both Rice and Zetterberg agree since the formula 
comes from one of Rice's classic papers; 13 namely 

*"-;<$ -{-£)■ (3G) 

Therefore, the overload noise according to Zetterberg is 

V. OVERLOAD NOISE — THE NEW APPROACHf 

In this section we will determine the overload noise using an approach 

which combines the more accurate model of Zetterberg with the correct 

averaging procedure given by Rice. 

* Zetterberg's expression corresponding to the A(\) given in (32) was not posi- 
tive for all values of X — clearly a n on physical situation. 

tin the present section we assume, without loss of generality, \p(0) = ff 2 = 1. 
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This formula lion proceeds as follows: 

(i) The average noise energy per burst is approximated by 
ave {/" m ( 8 ) ds\, as P er Zetterberg. This approach avoids Rice's ap- 
proximation of n(t) during a burst with a third-order polynomial and 
does not refer to the end point of the burst. On the other hand it yields 
clearly an upper bound on the overload noise, whereas in Rice's ap- 
proach the sense of approximation is not clear. 

(«) The averaging process is done the "correct" physical way in the 
following paragraph. This paragraph is a paraphrasing of the lucid 
lecture given to us by Rice. 

Consider a very long record of the input signal (Fig. 6) of time duration 
NT, where N is a very large positive integer and T is an extremely long 
time interval compared with the time unit. Mark on this time record 
of the input signal all points for which a positive burst begins — all 
points for which the derivative dx(t)/dt increases through x' . Mark on 
the record of the signal all time instants s time units following the 
beginnings of the bursts and measure the value of 7ii(s). Let K be the 
average number of "positive" bursts per unit time. Then the total 
number of "positive" bursts in the time interval NT will be: NTK. 
The average value of m 2 (s) over all these positive bursts will be 

Z W(«)l 
ave \nr(s)} = -^^ (38) 

Now break up the total signal record into N equal records of duration 
T and imagine them placed one below the other such that their begin- 
nings lie on the same vertical line as shown in Fig. 6. Divide the time 
interval into T/At equal small time intervals of length At and imagine 
vertical lines drawn at the dividing points. Consider a vertical strip 
of width At around time t and sum up the values of m 2 (s) over all 
members of the ensemble that have a "positive" burst which began in 
the time interval of duration At and around the time point t — s = t , 
i.e., s time units before t. This sum is independent of the vertical strip 
we consider and it is denoted by ^2m m 2 (s). 
If follows that 

NTK rp 

I>fc) =T f T,™ 2 ®- (30) 

.-1 Al At 

When a member x(t) is picked at random from the ensemble of the 
N x(t)'s we denote by p the chance that the following three things 
happen: 
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(i) A "positive" burst begins in the interval (t — s, t — s + At) 
or equivalently the derivative dx(t)/dt increases through x' n during 
t — s, t — s + At. 

(ii) The slope of dx(t)/dt at t = t - s lies between x[' and x[' + dx[' . 

(Hi) In the time interval (t, t + At), m(s) lies between m(s) and 
m(s) + d(m(s)). Since m(s) = x(t) — x(t — s) — .t,',s, this is equivalent 
to asking that X x = x(t — s) lie between a, and Xi + dx x where Xi is 
any real number and X 2 = aj(<) lie between .r 2 and z 2 + dx a where 
z a e fa + x' 8, oo ). 



Then we have 



p = .t"p(.Ti , x 2 , x'o , x[' ; s) cte, fte 2 dx[' At, 



where 



p(.r, , .r 2 , x'o , x[' ; s) 
is the joint probability density function of the random variables 



■ m, (s) 



m 3 (s) 



i s 



m 2 (s)- 



m 4 (s] 













1 \ ° 




t ( 


t.ts 


\ tsl / 


/K 2 +s 


u 


U + s \ 


A/^^Ia + s \ 



N - 




Fig. 6 — Illustration of the averaging procedure. 
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X, = x(t - S) = X(t ) 

X 2 = x(t) 



_ dx(t) 

Xl ~ dt 



(40) 



„ d 2 x(t) 



XV = 



df 



For an extremely large number N of members of the ensemble of 
x(t)'s the number of members satisfying the three conditions above 
will be 



pN = (NAt)x['p(x 1 , x 2 , x„ , x[' ; s) dx 2 dx x dx[' 
and therefore, 

£ m 2 (s) = f f" T (x 2 - Xi - x' s)\NM)x[' 

A( •'O •'-00 •'ii + io'i 

■p(xi , x 2 , x'o , x[' ; s) dx 2 dx x dx[' 
Consequently, 



(41) 



(42) 



ave [m 2 (s)\ = 



h g m2(s) 

NTK 



T7- \ I I \% 2 3-1 XqS) X\ 

J\- «/l) J_ M Jx t +zo'a 

■p{x x , x 2 , x'o , x'i ; s) dx 2 dx, dx[' 
Make the change of variables 

.To = Xi + X„S + U. 

Then 



(43) 



ave m 



2 (s)j = % j J J ri'ifpfri , *i + ZoS + w, x'o , xi' ; s) 

•dx, dx(' du. (44) 



Remark: 
Note that 1 



# = /* x"p(x' Q ,x") dx", 

Jo 



(45) 
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where p(x', x") is the joint probability density function of the random 
variables X' = dx(t)/dt and X" = d 2 x(t)/dt\ Using (20a), therefore, 
and substituting into (44) we can write 

ave [m 2 (s)} 

/.oo i»oo 
= / / tt"p*.(x, , X: + X& + U | X'(t ) = -To , x"(t ) > 0; s) 

JO •'-00 

•dx x du. (40) 

Hence, the present "physical" averaging procedure amounts to taking 
conditional densities in the horizontal window sense. 



„ r,.. i /6 2 y I .To 2 



(47) 



1 



On the other hand, 

p(xi , Xi + x' Q s + u, x' , x[ f ; s) = / 2 y YM I* exp ( "i 1 '-^" 1 *} . (48) 

where 



x = 



Xi + .-ToS + U 
X' 



X 

and x' is the transposed vector. M is the 4X4 cross-correlation matrix: 
{]".•;}> h i = 1» 2, 3, 4 and it is given in Appendix B. | M | is the deter- 
minant of M , 

After some very lengthy algebraic manipulations which are summarized 
in Appendix B we find [see (137)] 

ave {m\s)} = ^L jT«" exp [-i( 2+{7l ( s)) 2 ] ^5^2S^) & (49) 

where fci(s), <7i(s), and X(s) are complicated functions of s, expressed 
in terms of the signal autocorrelation function and its derivatives. They 
are given in Appendix B, (138), (135), and (128), respectively. Note 
that they do not coincide with Zetterberg's k(s) and g(s) as given by 
(22) and (23). Other symbols in (49) are defined below. 



£ = 



x(«) 
Vi - x 2 (s) 



(* + gM) 



(50) 



with 



Consequently, 
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(51) 

(52) 



Qx '„ = ave s / m~(s) ds 



= -4= / o °° Jbx(«) £° / exp [-iCH-fc(«))'] X(S) X2(S) ^(s £ ) A d«. (53) 

Up to this point we have made no approximations beyond those in- 
herent in the initial model. In the following, additional approximations 
are required to evaluate (53). In Appendix C it is seen that at s = 0, 
z - 

(54) 



and for s and z large 



Vbib a - bl Vb x 



£ = y lt z + 5 s, 



where y n and 8 are positive constants defined in Appendix C. The 
function <?(£) is plotted in Fig. 7. It is easily seen that, for g > 



m _ 1 + . 



^* 



-iva 



$V2tT 



1 -fr*'"*©}. 





/ 


5 


H5r~-^/ 


A 


/ 


^ 3 

8- 


- V^ j 


2 
! 


^^/ I SLOPE Jt ^ _ 






( 


2 3 



Fig. 7 — The function <p(£). 



2138 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1007 

For £ > we have 

fr* ,/2 *(€) < 1 
and for £ large 

1 -*•''■*© =p(l-p+ •••)• 
Hence, for $ large 



The derivative of y>(£) is very close to \/27r for large £. Namely, 

V2tt V&t' 

Note also that 

J>QL - 1.08, ^#= = 1.004, -*@L ~ 1.0002. 
V2tt~ 2V2tt 3V27T 

Hence, for £ ^ 2 the approximation 

<p(*)^f\/& (55) 

is very good (error less than 1 percent). The approximations hold good 
even for £ somewhat larger than 1, as seen in the calculations above. 
So that if £ > 1, as given by (54), it is justifiable, for the sake of sim- 
plicity, to substitute £ V^ for <p{£) in the integral (53). 

Another interesting comment here is that £ , as given in (54), is 
equal to the ratio of the absolute value of the mean of the third deriva- 
tive of the input process x{t) over its standard deviation. Indeed, the 
mean of x"(t ), where to is the begin ning of a positive burst, is —b&'Jb x 
and the standard deviation V(B/6 1 , where 



(B = V&i&s — &a 

[see Rice's comments above (18) of Ref. 8]. Rice assumed that this 
ratio is large compared to unity. Here the approximation is good even 
with £ close to 1. With the approximation introduced in (55) and using 
(50) we get 



A(S) 
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and consequently, 

Q.: - r *i(«) I" z\z + gi(s)) exp \-\{z + ffl (s)) 2 ] tfz ds. (56) 

Integrating in the inside integral by parts we get the simplified expres- 
sion 

Q X . Q = 2 [ " fc,(s) f 2 exp [-§(2 + <7i(s)) 2 ] <fe ds. (57) 

Jn «'o 

5.1 Approximate Evaluation of the Noise Energy per Burst 

The following asymptotic expressions for fcj(s) and g^s) are found in 
Appendix C, for s small 

*!<•) = X (58) 



£,(s) £j -gj-* x'os (59) 



and for large s 



Us) « fc M = ^ (60) 

*(*) « "% (61) 

The function j/(s) has an approximately linear variation for small 
and large values of s. 

To calculate Q a >, according to (57) we will use essentially the same 
approach used by Zetterberg; namely, use the asymptotic expression 
for (7i(s) near [see (59)] and for k(s) the expression (58) when s ^ s 2 
and (60) when s ^. s 2 . Here, s a is the value of s for which the two ex- 
pressions are equal; namely, 

S2 = Vt: = ~w~ (62) 



and 
where 



gi(s) = as, 



«-■$* ( 63 > 
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Bet 



X = as 2 = 



V2/2b 2 y /8 x' 



3 U?/ Vb x 



(64) 



The nature of approximation of the functions k v {s) and g x {s) by their 
values for large and small s is indicated in the Figs. 8 and 9. 

The evaluation of the integral (57) for Q x ., is done in Appendix D and 
the result is 



«-=#(tW 



where 



AM = 1 - 



„-X*/2 



V2t 



P(x) + 



V^ 



*(x)Q(x) 



(65) 



(66) 



P(x) = 2(f|x 6 + |x 8 + X 
Q(x) = 2(i| x G + x 4 -l) 



(07) 



The average overload noise power is obtained by multiplying Q x ., by 
the average number of bursts per unit time, given approximately in (3G). 
The average overload noise is, therefore, 



*-ife(Bffl , -'(-&*- 



(08) 




Fig. S — ki(s) and the approximation used for the evaluation of Q z \. 
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Vz 



/ 
/ 


g,( s > 

a 

32 o 


\ 3b, 

' APPROXIMATE 



Fig. ( .( — Approximation to gi(s) used for the evaluation of Q x \ ■ 



where x and A(x) are given in (64) and (66), respectively. This result 
is equal to Rice's result [see (22), Ref. 8] times A(x). For x large com- 
pared to unity A (x) is very close to 1 and thus, in this case (equivalent 
to x' being large compared to y/b[) the two results are identical. This is 
very interesting when we note that the route taken in the two approaches 
differ markedly. 

The factor A(x), for x > is a positive monotonically increasing 
function of x varying between and 1. The function A{%) is studied 
in Appendix E and —10 log 10 .A(x) is plotted in Fig. 10. 



VI. COMPARISON WITH COMPUTER SIMULATION AND EXPERIMENTS 

The new formula for the average slope overload noise power gives 
results for both, flat low-pass Gaussian, and band-limited RC Gaussian 
input signals, that agree in a very satisfactory manner with O'Neal's 
computer simulation. For flat low-pass Gaussian input signals we have 



&i = 



b, = 



(2x/n) g 

3 

(27T/.,) 4 



Using (64) we get, in this case, 

(3.6)* 



x = 



tVo" 



= (kF.) S 0.153(/,-F„ 



so that for kF, = 2, 4, and S we have, respectively, 
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Fig. 10 — The function —10 log, A (x). 



X, = 0.306 
A(xi) S 5.3 X 10 -3 



X 2 = 0.612 
A( X2 ) = 4.95 X 10" 2 



X3 = 1-224 
A( X3 ) S* 0.270 



and the corresponding corrections in O'Neal's curves (Fig. 4 of Ref. 
8) would be 

-10 1og 10 A(xt)^23dB 

-10 1og 10 A(x 2 )^13dB 

-10 1og 10 A(x 3 )^5.7dB. 

With these significant corrections the present analytical points pass 
through the computer simulation points, as seen in Fig. 11. Note that 
the slope overload noise as denned depends only on (kF.) and not F, . 
Excellent agreement with computer simulation also occurs for RC 
shaped bandlimited input signals. For RC-shaped signals with spectrum 
given by (6) of Ref. 8 we have 



&, = 



2irUa 



tan" 



Mo\ 



3 tan 
so that for a = 0.25/ (= 1/RC) 



(27r/ ) 3 a — Qrfoa , 4 
6 2 = : : r « 

-i 2*U 
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And from (64) 



ft, ££ 0.94$ 
ft 2 S 13.2/3 . 

X 2£ 0.744(fcF.) 



so that for kF. = 1 and 2 we have, respectively, xi = 0.744 and X2 = 
1.488 yielding a correction to Rice's" result of about 10.6 and 4.2 dB, 
respectively. A comparison with Fig. 5 of Ref. 8, reveals the agreement 
with computer simulation. 

For RC-shaped signals (Gaussian and bandlimited) with a = 0.068 
[corresponding roughly to the envelope of a black and white entertain- 
ment TV signal (FCC standard)] 

ft, = 0.267/; 

ft 2 = 3.57/S 

X = 1.62(/cF.) 

so that for kF. = £, \, and 1 the corrections are, respectively, 18.6, 
9.7, and 3.4 dB. Good agreement with computer simulation in this 
case may be noted by applying these corrections to Fig. 6 of Ref. 8. 



25 



15 



10 - 



5 - 



GRANULAR 
NOISE 




/ ' FORMULA BY 

/ RICE AND O'NEAL 

1 I I I 1 



16 32 64 128 256 

kF. 



Fig. 11 — Flat bandlimited Gaussian signals — comparison of the new results 
with previous analytic results and computer simulation. 
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Comparison of the new analytical result with experiment will be 
covered elsewhere. 

VII. OTHER STATISTICAL CHARACTERISTICS OF THE OVERLOAD NOISE 

7.1 Probability Density 

The technique used in the present paper, i.e., the substitution of 
m{s) for n(t) and the application of the averaging procedure presented 
in Section V, can be used for the determination of other statistical 
characteristics of the slope overload noise. 

For example, let q(m, s, x' ) be the probability density of ra(s), where 
s is a given number, i.e., a parameter, taking on nonnegative values. 
Let us define the following auxiliary probability functions g*(ro, s, x' ) ds, 
the conditional probability that x(t) — x(t — s)T x!,s lies between 
m and m + dm given that the derivative of x(-) increases (decreases) 
through x' between t — s and t — s + ds, where ra ^ and s > 0. 
Clearly, 

q~(m, s, .To) = q + (—m, s, xd) for m < 0. 

Also using the same averaging procedure as in Section V and the defini- 
tion of conditional probability densities in the horizontal window sense, 
we find that [see (20a) and (46)] 

q*(m, s, .To) 

= r pUxi , -r 2 = -r, + a& + m \ x' = x!> , x" > 0) dx s 

/ / xi'pfa , Xo = .r, + xfc + m, x' a , x[' ; s) dx[' dx { 

«/-oe Jo 

f X x'Mx'o , xY) dx[' 

•'0 

= jl f p tf'pfo . *" = - T ' + «»■ + m > • T '> I - T '' ' s ) dx " & 1 • 

From (100) and (101) we see that 

q\m, s, .r ) = } ^- P(m, s). 
(2ir) , A Vo(») 

P(«, ■) is defined in (101) and is determined in (116), Appendix B. 
It is easy to verify that 
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/ a \Q*(in,s,Xo), for m > 

[q~(m,s, Xo), for m < 0. 

Note also that there is a finite probability that m(s) = 0. Hence, the 
density q(m, s, x{ t ) contains an impulse at m = with strength p(s) 

p(s) = 1 — 2 / q + (m, s, x' ) dm. 

Jo 

The probability density of m, i.e., without specified s, is clearly 
PjtO»i -T,') = / g(«i, s, x'o) ds. 

Jo 

Clearly, P M {vi, xQ contains an impulse at m = of strength 



/ p(s) ds. 

Jo 



7.2 Other Statistical Characteristics 

Another useful attribute of the noise is its covariance (x(t)n(t)) av with 
the input random process. This quantity is of interest in comparing 
results obtained by a particular measured procedure with those obtained 
analytically. This will be discussed further in the paper referred to pre- 
viously. The evaluation of (xn) KV has been performed applying the 
method presented in Section V. The calculations are even more com- 
plicated than the ones employed in the evaluation of (n~(t)) liV and we 
will not consider them here. Moments of any order could be worked 
out. The expected value of | n(t) \ has also been determined. There 
are many statistical problems that may be generated by the study of 
slope overload noise in DPCM. These problems have their counter-part 
in the theory of level-crossings of random processes, but they are even 
more complicated. 
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APPENDIX A 

Correction o] Zetterberg's Q Xa 

The evaluation of Q Xo (Q y with the notation in equation 4.26 of 
Ref. 7) is not done correctly in Ref. 7 since A (x) in Equation (4.32) 
attains negative values. The integral to be evaluated is 



Q xa . = J- [ f k(s)u 2 exp [-i(u + g(s)) 2 ] du ds (69) 

\7T J i) Jo 

(70) 



with 




(0 g(s) = as, 


where 


x'oVTo 
a ~ 36, 


[see (25) and the following comments] and 


(n) k(s) = 


[b 2 s A t 

—r- , tor S ^ Si 
4 

2if/ , for s > Si 


where 


4 /8^. 


Make the change of variable 





u -\- as = v. 
Then 



Set 



(71) 



(72) 



^■=a4[i>^y^ /2dudv - (?3) 



X(v) = f ^—^)u 2 du = f k(£)(v - zf dz for v ^ as, = A* (74) 

J^.r.-jro,-^*-^ (75) 

*X here corresponds to Zcttcrberg's x. (X is introduced to avoid confusion with 
the input x(t).) 
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For v ^ X 

m 

2fr 



% = Y 2 = ( (v - z)V dz + X 4 f (v - zf dz 



= - Yq^ x +"3 Xy + x v - ( 76 ) 



Hence, 

n J2 12+A f x _,, /2 y 7 

\7T fl X _J„ 105 

Consequently, 



where 



and 



- 35X S / 2 (X) + 35X 6 /,(X) - ¥X 7 *(X)], (77) 
*(X) = J" e~'° /2 dz (78) 



7 n (X) = f 2V" /a tf* (79) 

,/„(X) - f gV iVa dz. (80) 

Integrating by parts we find the following recursive relations for J„ 
and J n , respectively, 



Clearly, 



and 



/.(X) = 


X*-V xva + {n - l)/„- 2 (X). 


(81) 




/o(X) = *(X) 


(82) 




Z.OO = 6- X,/ " 


(83) 


^n(X) - 


_ x n-l e -XV2 _|_ ( n _ l)J n _ 2 ( X ) 


(84) 
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with 

J (\) = f Q e~" /2 dz = ^- *(X) (85) 

J X (X) = 1 - <f XV2 . (86) 

Applying these recursive relations we find 

7 2 (X) = Xe- Xva + *(X), (87) 

/, = \V W2 + 2T Wi , (88) 

and 

,, - «[l - .— (£ + £ + £+ l)} (80) 

Substituting in (77) we get 

0-.' = \/~ 1 1 \» t 1 + P '( X ) C_XV2 - 0,(X)*(X)], (90) 

\7T a do A 

where 

Pi(X) - Hx" + #X< - U 2 - 1 

Q.(X) = Hx 7 + fix 5 . 

APPENDIX B 

Algebraic Manipulations with the Statistical Parameters 
Denote by 

M - {*,}(<. i - 1, ••• ,4) 
the cross-correlation matrix of the random variables 

X, = x{Q 
X 2 = x(t + s) 
dx(t ) 



X{ ~ dt 

_ d*x{Q^ 
Al " dt 2 

Then we have 

Mll = E(X\) = 1 
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M. a - m,m = E(X l X,) = E(x(t - s).r(/ )) = *( 8 ) 

Ml 3 = M31 = -^'P^A'D = 

V 2 «*V(r) 



Mm =M4, -Jy(X,X{0 = (-I) 1 



/*23 = M32 = E(X 2 X{) — — 



ds 



</-, 



= -wo 



= -6i 



M = 



(01) 



m„ = *, = e{x 2 xv) = (-D 2 ^ = m 

Maa - A'(A'f) - ft, 
Mm = m« = E{X[X[') = 
m,, = E(X['*) = b 2 . 
Therefore, 

" 1 ^(s) -&,' 

*(8) 1 -tf(s) £(a) 

-$(s) 6, 

L — &i $(s) o & 2 . 

Call | M | the determinant of M. 
It turns out that 

| M | = (6 2 - & 2 ){&,(1 - * 2 (s)) - f («)J - M*(«) + M(«) 

Denote by M (i (i, j = 1, • • • ,4) the co-factors of the matrix M. Since 
M is a symmetric matrix, M~ l is also symmetric and M ti = il/,-,- and 



(92) 



(93) 



M- 1 = 



1 



.1/ 



\U, 



(94) 



These co-factors are given in terms of the statistics of the input process 
as follows: 

Mu = Ma - M*(«) - M*(«) 

ilf I8 = -4<(s)(b 2 i(s) + M(s)) 
il/u - &,(&, + ft«)ft«) - \^ 2 (s)) 
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M 22 = biibs - b]) ( 95 ) 

M 23 = 4(s)(b 2 - b\) 

M 2i = -fttOftD + &i*(«)) 

M aa = (1 ~ + 2 (s))(b 2 - b\) - ($(s) + &,*(*))' 
M 3i = -$(s)($(s) + M(«)) 
M 44 = 6,(1 - Ms)) ~ 4 2 (s). 
It is easily seen that 

x'M-'x = t-^tt (ate? + 26.1-, + c), (96) 

where 

a = a(s) = M„ + 2M 12 + M 22 , (97) 

a function of s only 

h = (M u + M 24 )x{' + (M 12 + M 22 )(u + x'os) + (M ia + MM , (98) 
a linear function in x" and (w + x' s) 
c = M 4i x{' 2 + 2[M 24 (u + .To's) + M ai x' ] + M 22 (w + a&) a 

+ 2M 23 x' (u + a?o's) + Afasatf 2 (99) 

quadratic in a; J' and (u + z£s). 
Integrating with respect to x y in (44) we get 

K ave {tn 2 {s)\ 

- — iV? f w 2 r *" ex P {-^rrVi ( c - t) r rf:c " dw 

(2tt) 3 \/^D-'o Jo I 2 |M I \ at) 

= r±-= f u 2 P(u, s) du, (100) 

(2ir) i V^) J o 

where 

P(u, .) = f *!' exp {-^i (c - 9} *? . (101) 

It is seen that 

1 (c--) = A(s)x{' 2 + 25(s, u, x' Q )x[' + C(s, u, x' ), (102) 
\M \ a/ 
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where 

is a function of s only and 

B(s) = B l (s)(u + 4s) + B 2 (s)x f o 

= B,(s)u + (sB^s) + £ 2 (s))4 (104) 

is a linear function in u, with 

«.» = ff] {*- - (M " + ^y •• + M c° s ) 

B.(.) = i^i {m,, - < y " + y ff' ± "-> }■ (106) 
Further, 

C(a, u, 4) = C x (s)(w + x'os) 2 + 2C 2 (s).t> + 4s) + C 3 (s)x' 2 (107) 
is quadratic in u, where 

CM = i^i {m„ - '"" + ^ ■ ± "-> } (109) 

Substituting in (101) we get 
P(* |S ) = exp{-|(<7-^)} 

■J" xV exp |-| (*(' + |) j «fa{' . (Ill) 
Make the change of variables 

VA [x[> +j) = V. (112) 

Then 



2152 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1967 



Ate) 



exp<-J(C- 



A 



u _ _i_ r 

yl Jb/Va 



-lV2 



Set 



and 



where 



Hence, 



Clearly, 



V7(^ "' Va(s) u VIS) 



*(& = c-« va + {*(-€), 



<lr\ 

(113) 
(114) 

(115) 



*(.-!•) = / e~* V2 <te. 

P (w , s ) = -^exp{-|(c-f)}^). 

C(w, s) = C,(s)(w 4- ^s) 2 + 2C 2 (s)fa + X® + C 3 (s).xf 



(116) 



where 



= {uVCM + <?*(*)) 2 + 4 L '[C 3 (s) - £ 



g*(s) = x' r— 

v Ci 



CM 

C(«)J ■ 



(117) 



(118) 



and C^C*, and C 3 are given in (108), (109), and (110), respectively. 
Using these equations and the definition of a(s) in (97) we find 



M 



h> - aa 



= M m - 



(J/ ia + M 23 ) ; 
a(s) 



{Mn(M 11 + M 12 ) - M V ,(M X2 + M 22 )} : 
(M„M 22 - M 2 12 )a(s) 



(HO) 



We also note that 
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Mn _ Mn 3 _ f(s) 
M 12 M 22 &, 

[use (95)]. 

From (119) and (120) it follows easily that 



2153 
(120) 



M 



CM - £ (s) 



= il/aa — 






C\(s)_ 

Substituting the expressions for M 22 and M 33 from (95) we find 

M 22 f~ | M I 



M,, - 



b\ 



&, 



Hence, 

Set 

Then we have 

and from (114) 






v = uVCM- 



C = (v + g*( S )Y + |L 






vIW^W 



Using (120), the definitions of Bi(s), B 2 (s), C^s), and C 2 (s) in 
(106), (108), and (109), respectively, and the relation 



J/»4 _ t(s) 



resulting from (95) we find 



*»(*) _ C 2 (s) _ fts) 
J?,(s) C,(«) " 6, 



Hence, (124) becomes 



* - - 



ft 



VI 



= \(8)(p + g*(*)), 



(121) 
(122) 
(12.3) 

(124) 
(105), 

(125) 
(126) 
(127) 



where 



g*< 



2154 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1967 

X( S ) = jSM (128) 

and g* is defined in (118). Note also that 

'(*) = VCM (s + ^).r,', . (129) 

From (123) and (125) we get 

C - ^ - (1 - X 2 (s))(. + <7*( S )) 2 + ^- (130) 

Using the value of K given in (47) we find for the quantity P as given 
in (116) that 

I = j& (t;) 3 exp [ ~ U1 ~ x * mv + f®?k®' (131) 

Substituting in (100) and using the change of variable as given in 
(122) we get 

, 2/ u (b t /bof 

ave \m (s)\ = — 1= , — > — ■ 

V27r A(s) Va^) (VC[(8)) 

■ P v 2 exp [-1(1 ~ X a (s))(t> + g*(8)yM& dv, (132) 

•'0 

where £ and ?>(£) are given in (127) and (115), respectively. 
Now make the following change of variables: 



vVl - As) = z (133) 

and set 



g*(s)Vl - X 2 (s) = 9i (s) (134) 
so that from (129) 

M *fh.M tfA\ VMM,® ~ B?0>) nv(i 

g>(a) = ^ (6,8 + m ^j (135) 



Then 



and 



t= 7=^f (^+g,(«)) (136) 

VI - X"(s) 



ave [m 2 (s)j = ^L f\* exp [-§(* + g,(«)) a ] x q ® v® &> 

(137) 
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where 



, (s) _ (h) 1 -bmVW) am 

m ~ W VW) UisMs) - Bt(s))> (138) 

Finally, the average energy per burst becomes 

q "- = \fe r /c,(s) r " 2 exp [ ~ uz + &i(s))2] v \7 S ) x2(s) *® **• 

(139) 

APPENDIX C 

Asymptotic Behavior of Several Functions of s for s — > and s — * a> 

Assume that /*F(/) is integrable for n less than or equal to 8. For 
bandlimited signals, the usual case in practice, this requirement is 
automatically satisfied. 

For small s the following Taylor expansions hold: 

*(•) = 1 - 6. £ + h |J - b 3 £ + |J *<"(*), 

where is a number such thatO < < 1 and \f/ (s) (6s) is the 8th deriva- 
tive of ^(s) evaluated at 0s. 
For a signal bandlimited to the band (0, /,,) we have 

I + (8) (e S ) | 5S /)., 5S (27T/ ) 2 6 3 . 

Therefore, the absolute value of the remainder term satisfies the fol- 
lowing inequality: 



h * ,8, (««0 



Z.tW 



6! 56 



so that this term will be negligible if (27r/ n s) 2 « 56, i.e., if f s « 1.2. 
In the expansion for the first and second derivatives of i^(s) the first 
three terms are included and the remainder terms may be disregarded 
for the same values of s. 
Consequently, we have 

+(s) = -fca + b s |j - b 9 £ + |j * t8, (0 lS ) 
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with 

g $t t 0* £ l. 

We, now, obtain the asymptotic behavior of some expressions -/s 
which appear in the functions of s involved in the integral for Q z - a . 
Note that 

(0 1 - ««) = hi || - h £ + b a £ + 0(8") 

M i - ^) = ^ - (£ + ^ + (^ + f >° + o(0 

(m) TO = tf S 2 - ^ + (^ + (^V + 0(O 

(*) *<«) + 6, = *f - |f + 0(O 

(m + w = Y - Hf + 0(sS) 

(,) m + 6^( S ) = ^=^ s> + ^=^ s 4 + 0(O 

(w) (n«) + bins)) = 4 « + ^i s 

+ o(0- 

Using these formulas and the formulas of definition of the different 
functions of s we find after a considerable amount of algebraic manip- 
ulations, the following asymptotic expressions for s — * 0. Set 



(0 

(n) 
(Hi) 

(iv) 



(B = 


bib-3 — b 2 . 


a(s) 


~3o" S 


\M \ 


_ (h - &?)(B 


~ 3G 


A(s) 


~ (Bs 2 


BM 


186, 

~ mo* 
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(v) B ^ = - b - B ^-^~ 

i s /" r,\ t(s) r m ^ 366, 

(mi) ^(s)C,(s) - £;(«) « ^7 

o>) x( S ) = -— ML=^i 



Vl - \-(s) 1 / (B 



Using the formulas above we find that 

K_bmVa^_ b^ for s _^ 

\6 2 Va(«) {.1(8)C,(8) -tf(s)} 2 4 



and 

i.e., 

0i(s) = as for s small 
with 

, '4 

For s — > t», i/^(s), ^(s), and \f(s) approach zero. 

The following asymptotic expressions are easily derived for s — » «> : 
(/) a(«>) = 6,(26 2 - 6?) 

(t0 I M | - &t(6 2 - b\) 

2 



(m) A(oo) = 



2& 2 - 6? 



W B -(") = -267^ 
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(v) 5 2 (co) = 

(Vi) C,(oo) = '" 



2b 2 - bi 

(vii) C 2 (oo) =0 

1 



(ran) A(oo)C,(oo) - B?(oo) = 

(is) X(co) = 



26 2 - 6? 

V2&T 



(*) 



Vl - X 2 (oo) \/26 2 - 6f 



X(oo) &, 

Using these expressions we find 



and 



k x = lim k(s) = bt-U— 

m— tec » t/'2 



9i(s) ~ 77= for s -> 00 . 



Note also that for £ as defined in (50) we have 
(i) For z = and s small 

5 - *° - Vl - X 2 ( S ) 9l{) - V <B • *» 36, S - 

Hence, 

6 2 Xo 



& = 



(m) For s large 

. ^ V2?; 2 - b 2 , V2& 2 - &? , 4 , . 

b, b x V 2 



APPENDIX D 



Approximate Evaluation of Q x 
From (57) we have 



Q.>. - 2 r fc,(s) /" 2 exp [-Kji + <7.(s)) 2 ] (feds, (140) 
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where 



<7i(s) = as < s < 



fci(s) - 1 



k K [ — ) , for s £ (0, s 2 ) 



(141) 



.&«, , for s t (s 2 , «). 

The symbols a, s 2 , and fc M are defined in the relations (63), (62), and 
(60), respectively. 
Make the change of variables 



y — z + as. 



We then have 



Set 



Then 



Qs>. = ~ r<r w ' n f *.( K -\dzdy. 

a Jo .'o \ a / 

X(y) = J\kJ^^) dz = jT (y - rfthfy dr,. 

Q,. m = - [ X ' X(y)e-*' /2 dy. 
a J 



For y ^ x = «s, 

For ?/ ^ x 

X(y) v x° , . f , v , 8x° 5 , xV 

£/? = } 2 = 30 + x J x (V ~ v) dv = "15" ~ Xy + 2 

Consequently, 

Vi'o 1 r I 1 4t 5tiO <),., v 

2k K /ax 6\J 2, 15 

where *( x ), 7„(x), and J„(x) arc defined in (78), (79), and (80), respec- 
tively. 

Applying the recursive relations (81) and (84), we find 

Iiix) = e" xVS 

h(x) = xe-*' /s + *<x) 



(142) 



J« = 



- e" x ' /2 (x B + 5x 3 + 15x) - 15* W. 
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Substituting in (142) the values of J 6 , I 2 , Ii , we get 

%- = ^f {i - e — p( x ) + -j= HxMx)} , (143) 

Wax 4 I V2tt V2ir ) 



where 

and 

i.e., 

where 



P(x) = 2({lx + be + x) (144) 

Q(x) =2(Tfx R + x 4 -l), (145) 



_ "V27T k„ . ( v 



-XV2 [ 



A(x) = 1 - —7= P(x) + -7=- *(x)Q(x). (146) 

V27T V2t 

Using the expressions (63), (64), and (60) for a, x, and fc„ , respectively, 
we get 

Q "' = "^ ^f b;i ' A(x) = (RiCG ' S Results) ' A( X>- (147) 

APPENDIX E 

The Function A(x) 

The function A(x) as defined in (66) is a monotonically increasing 
function of x in the interval (0, «>) with A(0) =0 and A(<*>) = 1. 

The computation of A (x) for different values of x was performed using 
the computer and 10 log 10 1/A(x), the correcting factors of Rice's 
result, is shown in Fig. 10. 

Expanding into Taylor series we can find that for x small 

^(x)^x'-2jx 5 +( I ^ + ff)x^X*(I-1.0x + 1.44A 
whereas, for x large, using the asymptotic expansion for 
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we get 
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